processing step
OceanBench: The Sea Surface Height Edition
The ocean is a crucial component of the Earth's system. It profoundly influences human activities and plays a critical role in climate regulation. Our understanding has significantly improved over the last decades with the advent of satellite remote sensing data, allowing us to capture essential sea surface quantities over the globe, e.g., sea surface height (SSH). Despite their ever-increasing abundance, ocean satellite data presents challenges for information extraction due to their sparsity and irregular sampling, signal complexity, and noise. Machine learning (ML) techniques have demonstrated their capabilities in dealing with large-scale, complex signals.
OceanBench: The Sea Surface Height Edition
The ocean is a crucial component of the Earth's system. It profoundly influences human activities and plays a critical role in climate regulation. Our understanding has significantly improved over the last decades with the advent of satellite remote sensing data, allowing us to capture essential sea surface quantities over the globe, e.g., sea surface height (SSH). Despite their ever-increasing abundance, ocean satellite data presents challenges for information extraction due to their sparsity and irregular sampling, signal complexity, and noise. Machine learning (ML) techniques have demonstrated their capabilities in dealing with large-scale, complex signals.
From LIMA to DeepLIMA: following a new path of interoperability
Bocharov, Victor, Besançon, Romaric, de Chalendar, Gaël, Ferret, Olivier, Semmar, Nasredine
In this article, we describe the architecture of the LIMA (Libre Multilingual Analyzer) framework and its recent evolution with the addition of new text analysis modules based on deep neural networks. We extended the functionality of LIMA in terms of the number of supported languages while preserving existing configurable architecture and the availability of previously developed rule-based and statistical analysis components. Models were trained for more than 60 languages on the Universal Dependencies 2.5 corpora, WikiNer corpora, and CoNLL-03 dataset. Universal Dependencies allowed us to increase the number of supported languages and to generate models that could be integrated into other platforms. This integration of ubiquitous Deep Learning Natural Language Processing models and the use of standard annotated collections using Universal Dependencies can be viewed as a new path of interoperability, through the normalization of models and data, that are complementary to a more standard technical interoperability, implemented in LIMA through services available in Docker containers on Docker Hub.
Data Parallelism and Distributed Deep Learning at production scale (part 2)
Lastly, our optimiser is wrapped by Horovod's implementation for distributed optimisation (which handles the all-gather and all-reduce MPI operations). We next assign training callbacks to GPU processors based on the processor's (unique) global rank. By default, rank-0 is designated as the root node. There are some operations we only need executing on a single node (for example, using a model checkpoint to save model weights to file). Each processor will effectively run their own training job which optionally prints training accuracy, loss, and custom metrics to CloudWatch.
Critic Algorithms using Cooperative Networks
Banerjee, Debangshu, Wagh, Kavita
While most reinforcement learning algorithms aim at minimizing the Mean Squared Bellman Error, in function approximation it makes more sense to track the Projected Bellman Error. This is because with function approximation the true optimal of the Bellman Equation might not be representable by the function class. An example would be the true solution not being within the range space of the design matrix when using linear architectures. In such a scenario, one looks at the projected optimal solution onto the range space of the design matrix. This projected optimal solution is the fixed point solution of the Bellman Equation.
Natural Answer Generation: From Factoid Answer to Full-length Answer using Grammar Correction
Jain, Manas, Saha, Sriparna, Bhattacharyya, Pushpak, Chinnadurai, Gladvin, Vatsa, Manish Kumar
Question Answering systems these days typically use template-based language generation. Though adequate for a domain-specific task, these systems are too restrictive and predefined for domain-independent systems. This paper proposes a system that outputs a full-length answer given a question and the extracted factoid answer (short spans such as named entities) as the input. Our system uses constituency and dependency parse trees of questions. A transformer-based Grammar Error Correction model GECToR (2020), is used as a post-processing step for better fluency. We compare our system with (i) Modified Pointer Generator (SOTA) and (ii) Fine-tuned DialoGPT for factoid questions. We also test our approach on existential (yes-no) questions with better results. Our model generates accurate and fluent answers than the state-of-the-art (SOTA) approaches. The evaluation is done on NewsQA and SqUAD datasets with an increment of 0.4 and 0.9 percentage points in ROUGE-1 score respectively. Also the inference time is reduced by 85\% as compared to the SOTA. The improved datasets used for our evaluation will be released as part of the research contribution.
End-to-End Deep Learning for Self-Driving Cars
In a new automotive application, we have used convolutional neural networks (CNNs) to map the raw pixels from a front-facing camera to the steering commands for a self-driving car. This powerful end-to-end approach means that with minimum training data from humans, the system learns to steer, with or without lane markings, on both local roads and highways. The system can also operate in areas with unclear visual guidance such as parking lots or unpaved roads. We designed the end-to-end learning system using an NVIDIA DevBox running Torch 7 for training. An NVIDIA DRIVETM PX self-driving car computer, also with Torch 7, was used to determine where to drive--while operating at 30 frames per second (FPS).
Starkit: RoboCup Humanoid KidSize 2021 Worldwide Champion Team Paper
Davydenko, Egor, Khokhlov, Ivan, Litvinenko, Vladimir, Ryakin, Ilya, Osokin, Ilya, Babaev, Azer
This article is devoted to the features that were under development between RoboCup 2019 Sydney and RoboCup 2021 Worldwide. These features include vision-related matters, such as detection and localization, mechanical and algorithmic novelties. Since the competition was held virtually, the simulation-specific features are also considered in the article. We give an overview of the approaches that were tried out along with the analysis of their preconditions, perspectives and the evaluation of their performance.
Data-Driven Approach for Schedule Optimizations
Imagine you are the manager of a restaurant. Today happens to be a busy day, and you are now short of manpower to complete the orders from customers. The vegetables need to be washed, the chicken needs to be cut, meanwhile, the dishes need to be done… After the food is cooked, someone also needs to serve the food and collect money from customers. Seeing the to-do list getting longer and longer, now you are feeling a bit anxious: who should you assign to work on what tasks, so that you can complete all the orders within minimum time? The scenario I have just described is actually a scheduling problem by nature.
Monte Carlo Tree Search for high precision manufacturing
Weichert, Dorina, Horchler, Felix, Kister, Alexander, Trost, Marcus, Hartung, Johannes, Risse, Stefan
They can be treated as deterministic, as the noise of the manufacturing Monte Carlo Tree Search (MCTS) has shown its outcomes influence the processing result only to a minor strength for a lot of deterministic and stochastic extent. In this paper, we deal with the less common case examples, but literature lacks reports of applications of high precision manufacturing: here, the manufacturing to real world industrial processes. Common tolerances of the different processing steps are in the range reasons for this are that there is no efficient simulator of the product tolerance. As the manufacturing outcomes of the process available or there exist problems vary, the chain of manufacturing steps has to be adapted.